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Abstract — We consider the design of identical one-bit probabilistic 
quantizers for distributed estimation in sensor networks. We assume the 
parameter-range to be finite and known and use the maximum Cramer- 
Rao Lower Bound (CRB) over the parameter-range as our performance 
metric. We restrict our theoretical analysis to the class of antisymmetric 
quantizers and determine a set of conditions for which the probabilistic 
quantizer function is greatly simplified. We identify a broad class of noise 
distributions, which includes Gaussian noise in the low-SNR regime, for 
which the often used threshold-quantizer is found to be minimax-optimal. 
Aided with theoretical results, we formulate an optimization problem 
to obtain the optimum minimax-CRB quantizer. For a wide range of 
noise distributions, we demonstrate the superior performance of the new 
quantizer - particularly in the moderate to high-SNR regime. 

Index Terms — Minimax CRLB, dithering, probabilistic quantization, 
distributed estimation 



I. Introduction 

Distributed estimation is a classical problem in statistical signal 
processing, where a fusion center (FC) receives compressed data 
from several information nodes and infers the parameter(s) of the 
underlying process. Consider a distributed estimation problem with 
N sensors collecting noisy observations of an unknown but fixed 
scalar parameter 9 such that the local sensor observations X = 
[Xi,Xz, . . . Xm]' are independent and identically distributed (i.i.d.), 

i.e., f(X,6) = Il£=i /(*»,*), where f( X >°) and f(*n,0) are 
known probability density functions (pdf). One example of such a 
model is the location estimation problem with additive noise, 

X n = 9 + W n , l<n<N, (1) 

where the noise samples W — [Wi, W2, ■ ■ ■ Wn]' are zero-mean, 
additive, independent, and identically distributed with symmetric pdf 
f(w) and variance a 2 . In many practical applications, the dynamic 
range of 9 is often assumed to be known, such that 9 £ [9q — A, 9o + 
A] where 9q and A are known constants. Without loss of generality, 
we assume 9q — and A = 1 and confine our attention to 9 £ 
[—1,1] in the rest of this paper. 

As an application instance of this problem domain, one can con- 
sider an environmental monitoring system consisting of a central base 
station communicating with multiple thermal sensors with limited 
energy deployed over a region in a dense manner, so that they are 
more-or-less recording the same temperature at any given time. The 
redundancy in the number of sensors serves to increase robustness 
of the network, share the power resources and increase the lifetime 
of the monitoring system. The objective of the sensor network is to 
monitor the temperature in the region throughout the day, though the 
diurnal temperature variation (say 10 — 40°C) is roughly known. 
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A. Identical one-bit quantizers 

Since the channel capacity of links between sensors and the fusion 
center and the energy resources for transmission in the battery- 
powered sensor nodes can be severely limited, we assume that each 
sensor performs a binary quantization and transmits only one-bit of 
information to the FC. With an appeal to symmetry, each sensor is 
designed to employ an identical quantization rule. 

A one-bit quantizer can be defined as a mapping from the ob- 
servation space R to a symbol set of size 2, say {So, Si}. Such a 
mapping can be expressed in two forms. In the often used function- 
form description, a quantizer explicitly maps its input X n to the 
output Y n through a function tp : R — > {So, Si}. For example, the 
function-form description of a zero-threshold quantizer is 

4 U; £<S < v - (2) 

Alternatively, in the probability-form description, a quantizer is 
defined as the conditional probability 7 : H — > [0, 1] of the output 
being a particular symbol (say Si) given an input X n , 

j{X n )± P(Y n =Si\X n ),\/n. (3) 

For example, the equivalent probability-form description of the zero- 
threshold quantizer (2| is 

M*n)±{ l] llll ,Vn, (4) 

which we would refer to as the Threshold Quantizer. In this paper, 
we will use the probability-form description (3]l for analysis and 
subsequent design of quantizers. Here by allowing 7 to take any value 
between and 1, we consider all possible local quantization rules 
ITI . i.e., the quantization rule can be either deterministic (e.g., single 
threshold quantizer [2|,[3|) or probabilistic (e.g., dithered quantizer, 
i.e., some noise added to the signal before quantization |4|,|5|). 

B. Reliable Transmission 

In this paper, we assume that the stringent source-rate constraint 
(1-bit per observation) frees up resources so that adequate channel- 
coding is undertaken to counter noise/fading phenomena in the 
communication channel. As a result, the compressed information 
in Y = [Yi , Y2 , . ■ ■ , Yn] is assumed to be obtained in a lossless 
fashion at the FC, an assumption that is consistent with several 
previous research contributions on this topic (2j, (6). However, in the 
more general scenario, absence of sufficient resources for adequate 
channel-coding may result in lossy transmission of Y - an issue also 
considered by several researchers f7l. l8l. Though the results in this 
paper can be extended to noisy channel scenario, we shall not discuss 
this extension here due to space constraints. 

C. Performance metric 

The goal of the fusion center is to use the quantized observations 
and obtain an estimate of the location parameter 9 using an estimator 
h(Y,^f). The problem setup is summarized by the Markov chain, 

9 X A Y A 9. (5) 
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Let 8 be an unbiased estimator of 8. It is well known that the variance 
of any unbiased estimator is lower bounded by the Cramef-Rao lower 
bound (CRB) and that the CRB is asymptotically achieved by using 
the Maximum-Likelihood (ML) estimator (see [9|). Let g{8) denote 
the probability that the quantizer output is Si when the original 
parameter is 8, 

g (8) = p(Y n = Si\o) = E Wn {-r(e + w n )) 

/CO 
7 (x)f(x-8)dx. (6) 

Then the sample mean Y = i Si=i ^ ls tne ML-estimate of g(8) 
and from the functional invariance property, we have 



8 M L = g- 1 (Y). 
For N independent observations, the variance of 8ml satisfies 



(7) 



E{(0- 



1 



-CRB(0, 7 ,/), 



(8) 



) 2 } > — — 

> ' ~ N I{8) 

where 1(8) = -E w [V§ lnp(Yi ; 8)] is the Fisher Information (FT) 
for one sensor output and the equality can be achieved asymptotically 
0. In case of binary quantization, FI can be expressed as (see ITI). 



1(8) 



(g'(o)f 



g(8)(l-g(8)Y 



(9) 



In general, CRB(#,7;/) is a function of the unknown parameter 
8, i.e., the quantizer 7 may result in a high CRB for one 8 and a 
low CRB for another. To ensure accurate estimation over the entire 
parameter range, we use the maximum possible estimation variance 
or the maximum-CRB 



0( 7 ,/)= sup CRB(0, 7 ,/), 

»e(-i,i) 



(10) 



as our performance metric. 

Although it is relatively easy to obtain 0( 7 , /) for a given noise 
probability distribution function /(.) and quantization rule 7, the 
problem of determining 



0(/)=inf sup CRB(0, 7 ,/) 

t ee(-i,i) 



(11) 



has been shown to be extremely difficult and remains unsolved 1 1 1,| 3 1. 
We refer to the minimizer of \ \\\ as the minimax-CRB quantizer. Our 
goal in this paper is to design minimax-CRB quantizers for arbitrary 
noise densities. 

D. Previous work 

The problem of quantizer design for minimax-CRB criterion has 
been addressed only in terms of some scattered results till now. It 
is well known that the Threshold Quantizer (7T, see |4|), though 
widely used in the literature |2|,[3|, is unsuitable for high-SNR 
situations because the maximum value of CRB, typically occurring at 
boundaries, may exponentially increase with decreasing variance a 2 
0. This problem is often addressed by adding some additional noise 
(dithering) to the observation prior to threshold-quantization. We refer 
to this as Dithering Quantizer (7.0). Dithering is often necessary only 
in the high-SNR situations, when the noise variance is below a critical 
magnitude, say o~%. The critical variance depends on the shape of the 
noise pdf and is determined by [5] 



a T = arg inf <j>(yr,f{? ))■ 



(12) 



By design, the Dithering Quantizer has the limitation that the 
maximum-CRB actually flattens out (does not decrease) below the 
critical variance, e.g., for Gaussian noise it was shown in |5| that 

ajr « 2/tt. 



Zero-noise performance limit and Sine Quantizer (70 ): The 
performance limit of <j>(f) f° r me noiseless situation, i.e., when 
f(w) — S(w), was derived in [1|. For such a scenario, the optimum 
minimax-CRB quantizer and the corresponding performance were 
shown to be 



70 (z) = 



(l+sin^; 



X > 1 

xe [-1,1] 

x < — 1 



and 



0o = -2 « 0.4. 

TV 



(13) 
(14) 



It must be noted here that analogous performance limits for finite- 
variance noise densities are extremely challenging and their derivation 
remains an open problem. While the quantizer given by < | 1 3 [ > is 
insightful, it has limited applicability due to two reasons, (1) the 
noiseless scenario can only approximate high-SNR cases and (2) 
even for high-SNR cases, 70 may be far from satisfying the minimax 
property, as we shall show later in this paper. 

In this paper, we make some significant contributions towards the 
study of minimax-CRB quantizer design. We define antisymmetric 
quantizers and restrict our attention within that class. We determine 
certain conditions under which the shape of the optimal quantizer 
is greatly simplified, thereby enabling efficient implementation. We 
then identify a class of noise distributions for which the Threshold 
Quantizer is optimal. Lastly for other noise distributions, aided by 
some theoretical insights, we propose a class of piecewise-linear 
quantizers and formulate the quantizer design problem as one of 
numerical minimax optimization. The resulting quantizer is shown to 
perform significantly better compared to all three existing quantizers 
- namely the Threshold, Dithering and Sine quantizers. 



II. Main Results 

Before presenting the results, we provide some definitions that will 
be needed for subsequent discussion. 

Definition 1: A quantizer 7(1) is admissible if the resulting con- 
ditional probability distribution g(8) is monotonically increasing in 
0E(-1,1). 

The monotonic property is desirable since it ensures that <7 _1 (-) 
exists so the ML-estimator {7} is well-defined. The increasing prop- 
erty is without loss of generality, since, corresponding to every 
7(2;), there is another valid quantizer 7(0;) = 1 — 7(0;) such that 
fl(0) = li. x )fi. x — 8)dx — 1 — g(8). This reverses the 

increasing/decreasing property and yet has the same maximum-CRB, 
since by {9}, CRB(6>, 7 ,/) = CRB(6>, 7 , /). Hence it is sufficient 
that, in pursuit of a minimax-CRB quantizer, we restrict our attention 
to admissible quantizers. Alternatively, throughout the rest of the 
paper, any reference to a minimax-CRB quantizer will imply that 
it is admissible. 

Definition 2: A quantizer j(x) is antisymmetric if 



7(e) +t(" 



1. 



Vsr. 



(15) 



It may be noted here that traditional quantizers like the Threshold, 
Dithering, and Sine quantizers are antisymmetric. It is easy to see 
that antisymmetric property of 7(2) together with the assumption of 
symmetric noise pdf f(w) implies that g(8) is also antisymmetric, 
i.e., g(8) = 1 — g(—6). This further means that, 



CRB(0, 7 ;/) =CRB(-0, 7 ;/), 



(16) 



which imply that we can reduce the interval of interest in {10]| by a 
factor of half, i.e., either 8 G (—1,0] or 8 g [0, 1) is sufficient for 
analysis. 
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We note here that for an antisymmetric quantizer with symmetric 
noise pdf, g(8) can be simplified as, 



Laplacian 


Gaussian 


Noiseless case 


16/tt 2 1.62 


4/tt RJ 1.27 


4/tt 2 RJ 0.41 



g(6) = F(6) + y(x)£(0,x) dx, where (17) 

t/ — oo 

£(*,*) = -/(* + *), (18) 

and — /_ f(w) dw is the distribution function. 

Definition 3: We call a quantizer 71 (a;) dominant over another 
quantizer 72(2;) if 



CRB(0 )7 i;/) <CRB(0,7 2 ;/), V0 G (-1,1). 



(19) 



Clearly, a dominant quantizer is better in terms of performance, 
since it ensures a lesser maximum-CRB, i.e., 4>{"fi,f) < 0(72,/). 
As a passing remark, it may be pointed here that the reverse is 
not necessarily true, i.e., lesser maximum-CRB does not necessarily 
imply dominance. 

Definition 4: A probability density function /(to) is unimodal 
if it has only one maxima (at to = too, say), i.e., /'(to) > 
0, for to G (— 00, wo) and f'(w) < 0, for to G (too, 00). For 
example, commonly used Gaussian and Laplacian noise densities are 
unimodal. 

In certain cases, the support of a minimax-CRB quantizer can be 
highly restricted. Lemma [T] lays out such a scenario. 

Lemma 1: (Restricting the domain:) Assume the noise density 
/(to) to be zero-mean, symmetric and unimodal. Then an antisym- 
metric minimax-CRB quantizer is at most unit-support in the negative 
semi-axis, i.e., 

j(x) = for x < -1. (20) 

To establish Lemma [T] we show that, for any antisymmetric 7(2;), 
there exists a unit-support quantizer 7(2") (namely, the trivially 
truncated quantizer), 

C 1, x > 1 

70)= I j(x), a; 6 [-1,1] , (21) 
[0, x < -1 

that is both antisymmetric and dominant over j(x). The full proof 
is provided in Appendix |A| 

The unit-support property helps make the quantizer structure 
simpler, which will be key in a subsequent theoretical result as well 
as our numerical design in Section [ill] We note here that for an 
antisymmetric unit-support quantizer with symmetric noise pdf, g(0) 
and g'(8) can be simplified as, 



TABLE I 

Lower bound on maximum-CRB using Sine Quantizers. 

variance a 2 > 1, no probabilistic quantizer (within the antisymmetric 
class) can decrease the maximum-CRB beyond the Threshold Quan- 
tizer. 

We end this section by pointing out a deficiency of the Sine 
Quantizer that we alluded to in the introduction. We show that the 
CRB at the boundaries (9 — ±1) for vanishingly small variance 
(<r 2 — > 0) is more than twice of that predicted for the noiseless case. 
The exact degree of sub-optimality depends on the shape of the noise 
density and is summarized in Proposition [T] below. 

Proposition 1: (High-SNR sub-optimality of Sine Quantizer.) Let 
f(w;o 2 ) denote a family of zero-mean, symmetric noise densities 
with o 2 signifying the variance. Assume that the moment condition 
a ~ 4 w4 f{ w ) °" 2 ) dw < 00 is satisfied. Then, 

lim 0( 7o , /(to; a 2 )) > lim CRB(±1, 7o ; /(to; a 2 )) (25) 

<T 2 ->0 (T 2 -»0 



> 



(27) 



where /«i is the normalized one-sided mean, [X\ 
<T ~ 1 Jo°° wf(w;o 2 )dw. 

The proof of Proposition [TJ is provided in Appendix [D] The bound 



opc 

in Proposition u\ can be compared directly with the theoretical 
limit (14} to note that it is twice as large. For illustration, the 
specific limit in \26\ for Gaussian and Laplacian pdf is tabulated in 
Table [^(derivation in Appendix [E]). We will further substantiate these 
results numerically in Section |IV| In terms of a low-noise sensing 
application with a pre-specified allowable distortion, Proposition [T] 
quantifies the scope of improvement over Sine Quantizer - by a 
judicious design of quantizer (detailed subsequently in Section [Till), 
we can potentially reduce the required number of sensors to half. 

Proposition [T] highlights the sub-optimality of the Sine Quantizer, 
which necessitates an alternative quantizer design in the high-SNR 
regime. Even in the moderate-SNR regime, in the absence of concrete 
analytical results for finite variance scenarios, it is not clear how one 
should design efficient minimax-CRB quantizers. In the following 
section, we describe a quantizer design method through direct nu- 
merical optimization. 

III. Antisymmetric minimax-CRB quantizer as an 

OPTIMIZATION PROBLEM 

A general probabilistic quantizer j(x) is any function that maps 
(—00,00) — > [0, 1]. But numerical search within such a functional 
space is extremely difficult and hence we make some additional 
assumptions. 

First, the proposed quantizer 'yp(x) is assumed to be antisymmet- 
ric, and the noise density is assumed to be symmetric. From Lemma 
[T| this also means that it is unit-support. To further simplify the 
structure, we assume that yp (x) is piecewise linear. Hence, we divide 
the support interval [—1,0] into several equally spaced intervals. We 
choose the observation grid-size or the number of grid intervals 
K so that K A x = 1. Define a = and for k = 1, 2, . . . , K, the 
following, 

T> k = [xk-i,Xk], where Xi = —{K - i)A x 
7p(x) = a k -i + m k (x — x k -i), for x G V k , and (28) 
a k = a fc _i + m k A x , 

(derivation in Appendix O. Therefore, for Gaussian noise with where mi , vti2 , ■ ■ ■ , rriK are the slopes that need to be chosen. 



g(6) = F(6)+J y(x)£(0,x)dx, and 
g'(0) = f(S) + ^ { j* j(x)m x) dx 



(22) 



(23) 



In certain cases, the Threshold Quantizer (-yr) is also the minimax- 
CRB quantizer, an example of which is provided in Theorem [T] 

Theorem 1: (Optimality of Threshold Quantizer:) Assume the 
noise density /(to) to be zero-mean, symmetric, unimodal and such 
that 



f'(w- z) + f'(w + z) < 0, for to G [0,1], z G [0,1]. 



(24) 



Then, the Threshold Quantizer is dominant over all possible antisym- 
metric quantizers. 

The proof of Theorem [T] is given in Appendix [B] This is an 
important result, since condition (24| is satisfied for a wide family 
of noise densities, including the following example. 

Example [7]i.- Gaussian density: For Gaussian density with 
variance a 2 , it is easy to see that condition \24\ holds for o 2 > 1 



TO APPEAR IN IEEE TRANSACTIONS ON SIGNAL PROCESSING 



4 



Notation: Henceforth, we will refer to the quantizer jp(x) as the 
Antisymmetric Unit-support Piecewise-Linear (AUPL) quantizer. The 
AUPL quantizer is entirely specified in terms of the slope vector m. 

Objective Function: We characterize the objective function in 
terms of m. For the piecewise linear quantizer jp, the expressions 
(22) and l |23[ > reduce to linear functions of m, i.e., 

g{6) = [a(6)] T m + F{e), and 
g'(6) = [c(9)] T rn + f(6), where 

a(e) = j q (e) + r(e), 

c(6) = Jq'(e) + r'(6), 

[K 1 ••• 1" 
K-l ■•■ 1 



J4 



[q{6)\ k = A x / £(p,x)dx, and 
[r(6)] h = f xt(0,x)dx, fc = l,2, 



,K. 



Next we discretize the parameter set. We note that the region of 
interest is only 9 £ [—1,0], with the other half taken care of through 
symmetry. We choose the parameter grid size Ag or the number of 
grid partitions L so that LAg = 1. Let the discrete points be 

61 =~, for J = 0, (30) 



Next, the maximum-CRB due to quantizer 7p (see is approxi 
mated as 

(afm + Fi)(l 



(m,f) 



max 
1 



T 

a t m 



Ft) 



[cfm + ft] 



(3D 



where a, 4 a(ft), c, = c(ft), F, 4 and /, 4 /(ft). 

In Equation 131) , <f>(-,f) is our objective function with m as the 
variable. 

Constraints: We identify two constraints. Firstly, the slopes rrik 
must be chosen so that the probability values for all observations 
x satisfy Jp{x) £ [0,1]. Since 7p is piecewise linear, this is 
ensured by placing inequality constraints at the boundary points. 
From {28}, we obtain ^p(x k ) = A x E*=i m J = ^I]j=i m j- 
Hence the probability constraint at point x k can be expressed as 



< E 



< K, for k — 1,2, ...,K. Secondly, from the 



antisymmetric property, assuming that jp(x) is continuous at 0, we 
have 7p(0+) = 7p(0— ) = 1/2, and hence we need to ensure that 
7p(0) = Jp(xk) = 1/2, or equivalently, Ej=i m i ~ K/2, 

Optimization Problem: Finally, the minimax-CRB quantizer <j>(f) 
defined by l|TTJ can be obtained as a solution to the following 
optimization problem in R K , 



minimize 



s.t. 



m < 



-L 
L 





Ki K 

(ik) 1 fn. = K/2, where 



and 



(32) 



L4 



1 

1 1 



and ik — 



(33) 



Implementation Notes: It may be noted that aj, c\ , Fi , fx in 
<f>(m, f) (see \31\ ) are all constants and may be pre-computed 
before running the optimizer. Also, once the noise pdf is known, 



it /4, Zero-noise Limit 



Y p , AUPL Qtzr 




(a) Std. Dev. of Laplacian Noise, a 



(29) 



j?/4, Zero-noise Limit 


Y p , AUPL Qtzr 




Y . Sine Qtzr 




Y D , Dith. Qtzr 


- it/4 


Y T , Thr. Qtzr 





(b) Std. Dev. of Gaussian Noise.a 

Fig. 1. Minimum Fisher information (</>(7, /) — 1 ) for Threshold, Sine, 
Dithering and AUPL quantizers for (a) Laplacian and (b) Gaussian noise. 

the optimum quantizer 7p can be computed offline and programmed 
into the sensor nodes. Choice of K and L essentially provides a 
tradeoff between discretization artifacts and numerical complexity. 
From numerical experiments, K — L ~ [10/c] was found to yield 
sufficiently convergent results. The problem given by {32} is not 
known to be convex (to the best of authors' knowledge) and hence we 
require multiple and good starting points mo to obtain a satisfactory 
solution. In our implementation, we have chosen two starting points 
for mo, namely the closest AUPL counterparts for the Threshold and 
Sine quantizers. We have used the MATLAB function FMINCON for 
optimization. 

IV. Illustrative Examples 

We illustrate some of the key ideas in this paper through numerical 
results. 

Sub-optimality of Sine Quantizer: In Proposition[T] we showed that 
the Sine Quantizer given by l |13[ >, though optimum for zero-noise, is 
significantly sub-optimal when o is small but finite (high-SNR). The 
results displayed in Figure [T] illustrate this phenomena. We display 
the minimum Fisher Information (inverse of Cramer-Rao bound) of 
the Sine Quantizer. As illustrative noise pdf-s, we consider Gaussian 
and Laplacian densities over a wide range of variance (0.05 < a < 
8). The dotted line showing (fig 1 = 7r 2 /4 is the zero-noise limit. 
The dash-dotted lines corresponding to 7r 2 /16 and 7r/4, which are 
significantly less than the zero-noise limit, denote the performance 
of the Sine Quantizer. These results are consistent with the limits 
described in Table I. 

Performance of AUPL quantizer: In Figure [T] we have also com- 
pared the AUPL quantizer 7p with the Threshold jt, Dithering 70 
and Sine 70 quantizers. The critical standard deviation for Dithering 
Quantizer correspond to the maxima of the performance of 7t (recall 
{T2}). In Figure [T] 70 corresponds to the unbroken horizontal lines 
connected to the maxima of performance curves. These critical 
variances are seen to approximately o~c ~ 0.79 and ctat ~ 0.63 
for Laplacian and Gaussian noise respectively. We observe that the 
AUPL quantizer performs better than all three existing quantizers, 
and considerably so in the moderate to high-SNR regime. 

Minimax-optimality of Threshold Quantizer: We showed in Exam- 
ple [T|l that for Gaussian density with a > 1, the Threshold Quantizer 
is also the antisymmetric minimax-CRB quantizer. We verify in 
Figure |TJ(b) that the performance curves for AUPL and Threshold 
quantizers coincide for a > 1. In fact, they seem to coincide 
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(b) Observation value x, Gaussian Noise 
Fig. 2. Designed probability "fp(x) = P(Y = 5i|x) for AUPL quantizer. 



V. Conclusion 

In this paper, we studied the design of identical binary quantizers 
for distributed estimation using minimax Cramer-Rao lower bound as 
the performance criterion. Among other theoretical results, we have 
specified a broad family of distributions for which the Threshold 
Quantizer is optimal. Aided with some theoretical results, we formu- 
lated a numerical optimization problem to obtain the minimax-CRB 
quantizer within the antisymmetric and piecewise-linear class. We 
demonstrated the superior performance of the AUPL quantizer for a 
wide range of noise density functions. Though AUPL quantizers can 
demonstrably achieve better performance, there are some drawbacks 
of the same that deserve mention. Firstly, AUPL quantizers are more 
difficult to implement because of the numerical complexity involved 
in the design process. Traditional quantizers like Sine, Threshold and 
Dithering quantizers are relatively simpler to design. Secondly, since 
AUPL quantizer is tailored to a particular noise density, it may not be 
suitable for applications where the ambient noise changes frequently. 
Lastly, the AUPL quantizer in Section [Til] was derived under the 
assumption of noiseless channels. Extension of AUPL quantizer to 
noisy communication channels merit further investigation. 
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(b) Parameter value 6, Gaussian Noise 
Fig. 3. Overall probability g(9) = E w (-yp(9 + W)) for AUPL quantizer. 

somewhat earlier, around a > 0.7. This is because dominance 
(see Theorem [T} is only a sufficient condition for minimax-CRB 
superiority. It may also be noted that no such coincidence is observed 
for the Laplacian case (Figure [TJ(a)). Since the Laplacian density is 
not differentiable at the origin, Theorem[T]does not apply in this case. 

Shape of AUPL quantizer: We display the shape of AUPL quan- 
tizer 7p(s) and corresponding g(9) for various noise pdf-s in Figures 
[2] and [3] respectively. We consider Laplacian and Gaussian pdf-s for 
small (<t = 0.05), medium (a = 0.2) and large (a — 0.7) variances. 
We note that for Gaussian noise, the AUPL quantizer displays a 
damped oscillating behavior, where the bumps get smaller but more 
in number, with decreasing variance. In the limit of small a, the 
AUPL quantizer is seen to approach the shape of the Sine Quantizer, 
though not exactly. In the limit of large a, for the Gaussian case, 
the AUPL quantizer is seen to approach the shape of the Threshold 
Quantizer. Figure [2] also shows that 7p need not be monotonic. 
This is in contrast with commonly used Threshold, Dithering and 
Sine quantizers, all of which are monotonic. The AUPL quantizer 
relaxes this assumption and allows for non-monotone functions. The 
overall quantizer probability g(9), however, has to be monotonically 
increasing in £ (—1, 1) to satisfy the admissibility property (see 
Definition [TJ. This can be verified in Figure [3] 



Appendix A 
Proof of LemmaQ] 

Let g(9) be the conditional probability corresponding to 7(2;). We 
need to show that 7(2;) dominates 7(2;) for the (half-range) 9 £ 
[0, 1). Refer to the expression of 1(9) in {9}. It suffices to show 
that the numerator and denominator terms satisfy, for 6 G [0, 1), 
the inequalities (N) (g') 2 < (gj 2 and (D) g(l - g) > g(l - g). 
Since admissibility (Definition m} implies g' > and g > 1/2 for 
9 G [0, 1), it suffices to show that (Nl) g' < g' and (Dl) g < g. 
From ifTT}, we obtain 

-1 



J (x)(f(x-e)-f(x + e))dx. 



(34) 



With unimodality of f(w) implying f(x — 6) < f(x) < f(x + 9), for 
x G (—00, — 1), 9 G [0, 1) and 7(1) being positive by definition, (Dl) 
is established from ([34}. Since f'(w) > in (-co, 0) (see Definition 
[4], we can interchange the order of integration and derivative in {34\ , 
to obtain, 

9-9 = - f 1 7(z)(/'(z -e) + f'(x + 9)) dx < 0, 
J —00 

thereby establishing (Nl). 

Appendix B 
Proof of TheoremQ] 

Note that conditions for Lemma [T] are satisfied, hence it suffices 
to show that the Threshold Quantizer dominates any admissible 
antisymmetric unit-support quantizer 7(2;). Refer to expression of 
1(8) in {9}. It suffices to show that the numerator and denominator 
terms satisfy, for 9 G [0, 1), the inequalities (N) (g') 2 < (f) 2 and 
(D) g(l — g) > F(l — F). Since admissibility (Definition [1} implies 
g' > and g > 1/2 for 9 G [0, 1), it suffices to show that (Nl) 
g' < f and (Dl) g < F. From the definition of £(9,x) in {Tg] and 
condition |24}, we have for x G [— 1, 0], 9 G [0, 1) 

d 



dO 



i(e,x) = -(f(x-e) + f(x + e))<o. 



(35) 



Since 7(2;) is always positive, Equations {23} (with interchanged 
order of integration and differentiation) and {35} yield (Nl). By 
integrating Equation {35} along 9 G [0, 81] with the boundary 
condition £(0, x) = (which is true by definition), we obtain 



£(61, x) < 0, for x G [-1,0], 0i G [0,1). 



(36) 
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Once again, since y(x) is always positive, Equations \22) and {36} 
yield (Dl). 

Appendix C 

DERIVATION FOR EXAMPLE 1.1 

We will show that l |24[ > holds for Gaussian distribution with a 2 > 
1. Since unimodality ensures that f'(w) < for w > 0, it suffices 
to show that {24) hold in the (restricted) domain < z < w < 1. 
Noting that f'(w — z) = —f'(z — w) (from symmetric property of 
f(w)) and defining a = w/z, it suffices to establish 



f'(z(l + «))</'(*(! -a)) 



(37) 



for the domain a £ [0, 1], z S [0, 1] and cr 2 > 1. Substituting 
f'(w) = — (y/2ira i )~ 1 wexp(—w 2 /(2a 2 )) and rearranging terms, 
condition \37) is equivalent to showing 

2 

(38) 



1 + a . 2az 2 
log- > 



1 - a 

The following identity can be ascertained easily for < a < 1 

h(a) = log - 2a > 0, (39) 

1 — Q 

by noting that /i(0) = and fa' (a) > 0. The additional conditions 
< z < 1 and a 2 > 1 imply {38}, thereby completing the derivation. 

Appendix D 
Proof of Proposition!]] 

We would prove Equation {26\ and {27}. Starting from {22\ , for 
9 = — 1 and small ct we proceed from l |22^ as follows 

ff (-l) = F(-l) + y° 70 (x) (/O + 1) - /(x - 1)) dx 

F(-l) + / 1 7 o(* - 1) (/(*) - f{z - 2)) dz 
Jo 



(a) 



(c) 



T0 (z-l)/(z)d« + O(O 



(40) 



2 2 

(d) 7T a 



32 



+ 0(0, 



where (a) is due to change in variables, (b) is due to bounding 
three distinct terms. First, F(— 1) = J"_J /(z) dz can be bounded 
to 0(a 4 J] assuming that the normalized fourth-moment is bounded 
and applying an inequality (precisely, no. 26.1.41) in |10|. The 
other two terms are themselves bounded by F(—l), i.e., 7o(z — 
l)f(z) dz < /" f(z) dz = F(-l) and l0 (z - l)f(z -2)dz< 
Jq f(z - 2)dz < F(-l) and hence are of the order 0(a 4 ). (c) 
follows from the Taylor-series expansion of j!3[ > in the vicinity of 

2 = 0, 

,(,-l)^[l-cos(f)]^ + (A 

and (d) follows from the partial moment relation J °° z n f(z) dz = 
0(a n ). Similarly, for g'(6) in ((23), 



ff'(-l) 



2 r°° 

T I 2 rl 



16 



z z f{z)dz + 0{a A ) 



(41) 



o 



where (a) follows from integration by parts and the fact that 
^ 2 /(^)lo° = 0. Applying (|40} and {44} in ^ we obtain <(26j). 

The normalized one-sided mean fii depends on the shape of the 
noise density and the inequality in l |27[ > is due to the fact that /ii < 
1/2 for any zero-mean, symmetric noise density f(w). Consider the 
function 



fo(w) 



2f(w) 




w > 
w < 



(42) 



a 2 pj^j and the one-sided mean is 
1 e _t dt denotes 



which is also a density function since j^° ao fo(w)dw — 1 and 
hence must have a positive variance. Thus Var/ (™) = Ef (w 2 ) — 
(E fo (w)) 2 = ct 2 (1 -4fij) > 0. Hence m < 1/2. 

Appendix E 
Derivation of limits in Table[I] 

To derive the limits in Table [i] we consider the generalized Gaus- 
sian density 1111 . specified in terms of the shape parameter /3 and 
variance a 2 as f(w;/3,a 2 ) = 2 ar(i/p) ex P (~ i\ w \/ a )j' where a 
is related to variance by a 2 

/>/W^ = fM- Here F(b) 4 /»f 
the Gamma function. Common densities like Laplacian (/3 = 1) 
and Gaussian (/3 = 2) pdf-s are specific examples of this family. 
From 1 1 1 1, the normalized fourth-moment is <r -4 w 4 f(w; a 2 ) = 

r(i/_^ j ' wmc h is clearly bounded for finite /3. Hence Proposition jlj 
applies, and we have from (26) . 

^crb, ± i, 70 ./,„ ; ,,^,) = A!M3|«. m 

Specific instances of this result j3 — 1 and j3 = 2 are shown in Table 
|l| Note that T(l) = 1, and T(b) = (6 - 1)T(& - 1) for all 6 > 1, 
which simplifies to T(6) = (6 — 1)! for integer b > 1. Furthermore, 

r(i/2) = V^- 
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'Recall the Landau or "big O" notation: a function / is asymptotically 
bounded above by g, written f(n) = 0(g(n)), if there exist constants N > 
and c > such that f(n) < cg(n) for all n > N. 



